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ABSTRACT 


Visual aids are valuable assets to engineers for design, demonstration, and evaluation. This report discusses a 
variety of advanced three-dimensional graphic techniques used to enhance the displays of test aircraft dynamics. 
The new software’s capabilities are examined and possible future uses considered. 

NOMENCLATURE 

C color 

DAH dynamic aircraft flight imaging 

IEEE Institute of Electrical and Electronic Engineers 

IP internet protocol 

IRIS interactive raster imaging system 

Nb the bisect vector 

N p normal vector to the surface at point P 

N PI vector from point P to the light Pi 

Nx normal vector parallel to x-axis 

Ny normal vector parallel to y-axis 

Nz normal vector parallel to 2 -axis 

OFF object file formatting 

P point 

Pi light source 

RGB red-green-blue 

RPV remotely piloted vehicle 

TCP transmission control protocol 

UDP user datagram protocol 

INTRODUCTION 


Viewing strip charts has been a common method of monitoring simulation and flight data. Strip chart readouts 
do not provide readily clear pictures of the complex dynamic motions of aircraft. Computer imaging can improve 
the analysis of test data by using visual aids. Graphic display software is useful because it can simulate the real 
world. Physical laws and natural phenomena are integrated into the software coding as algorithms of mathematical 
equations and calculations. Only after realistic simulations are provided can graphic display software be useful to 
engineers and scientists. The simulations are provided by applying computer graphic techniques. 

A new approach to applying computer graphic techniques was used to create a program to enhance the display 
of the dynamic characteristics of research aircraft. The program runs on the interactive raster imaging system (IRIS) 
which uses various graphic techniques for the drawing, shading, and lighting of a displayed X-29 aircraft model. 
The software is driven by real-time data from the simulation computer. Dynamic velocity vector components (fig. 1) 
are juxtaposed on the X-29 model. The model is dynamically driven by three-axes attitude data, so the engineer 
immediately knows what the aircraft is doing. An engineer can determine the angle of attack, the angle of sideslip, 
and the velocity of the aircraft, among other uses. This paper describes the system and program used to show the 
motions of the X-29 aircraft 



SYSTEM OVERVIEW 


The development of graphic display software entailed two considerations, how the software would function and 
which hardware to use. The software used to display and manipulate a three-dimensional, filled-polygon model of 
an X-29 forward-swept- wing aircraft was comprised of “C” language routines referred to as dynamic aircraft flight 
imaging (DAFI). The routines of the DAFT package were obtained from existing software packages used on the IRIS 
workstation. The database for the three-dimensional, X-29 display came from a demonstration program provided 
on the IRIS. The routines, derived from MYLIGHT (written by Michael J. Zyda of the Naval Postgraduate School, 
Monterey, CA), read the model data from various files and supported translation and rotation of the model. Data for 
the X-29 simulator is processed in an Encore/Gould/S .E.L. Concept 32/9780 computer. The simulation computer 
processes specified aerodynamic parameters by converting Gould formatted floating point numbers to Institute of 
Electrical and Electronic Engineers (IEEE) floating point standards. The processed data is directed as an 80-Hz 
output to the IRIS workstation, which can display graphics at a 60-Hz screen-clear rate. The parameters are used 
within the algorithms for the drawing, shading, and lighting of the displayed image. 

THREE-DIMENSIONAL GRAPHIC TECHNIQUES 


The rapid advancement of computer technology and high-quality graphics systems has provided today’s engineer 
with the ability to display images which before could only be imagined. The IRIS provides users with the ability to 
produce basic two-dimensional and highly realistic three-dimensional images. The two-dimensional displays rely 
on a screen x- and j/-coordinate system, with the positive a: -axis directed from the left to the right side of the screen 
and the positive y-axis directed from the bottom to the top of the screen. Three-dimensional displays use a z-axis 
which has a positive direction out from the screen. 

One technique used by the IRIS for three-dimensional imaging is hidden-surface removal. Hidden-surface re- 
moval involves displaying only the surfaces of a three-dimensional object which could be seen and not displaying 
surfaces out of eyesight. Two algorithms for hidden-surface removal are z-buffering and backfacing-polygon re- 
moval. The z-buffering operation calculates the distance from the surfaces covering each pixel to the eye and draws 
only the surface that is closest. The raster subsystem assigns a screen z-coordinate value to each pixel used to fill 
a polygon. Before a pixel is written into the frame buffer, the previous z-coordinate used to set that location is 
checked. If the new point is closer than any previous point, then the color in the frame buffer is changed and the 
z-coordinate in the z-buffer is changed to reflect the new, closer point. Any new points further away are discarded 
(GT Graphics Library User’s Guide, Silicon Graphics, Mountain View, CA). 

Another hidden-surface removal technique is backfacing polygon removal. In this technique, each polygon face 
of an object is drawn in counterclockwise order, as viewed from outside the object. If the object is rotated halfway 
around the jr-axis, the faces on the front will be in counterclockwise order and those on the back will be in clockwise 
order. The IRIS system can be put in a mode where only counterclockwise polygons are drawn, so the hidden 
surfaces of a three-dimensional object will be removed (as described in the GT Graphics Library User's Guide). 
Because the z-buffering algorithm is more reliable, it was used instead of backfacing polygon removal. Figure 2 
shows the basic operation of each hidden-surface-removal algorithm. 

The shading characteristics of an image improve its realism and appearance. For two-dimensional, uniformly 
colored objects, flat shading may be applied. For curved surfaces, colors vary continuously across the surface, 
so a flat-shaded polygonal approximation to the surface looks tiled! Gourad shading, also known as “intensity 
interpolation shading," makes light intensity smooth across polygons. Gourad shading accommodates the depth 
expectancy of three-dimensional objects, so it was used for program development rather than flat facet shading. 
Figure 3 shows the graphical quality improvement of gourad shading over flat shading. The Gourad shading is 
accomplished by: 3 =^- - , - - 
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1. Calculating the surface normals for each polygon, which determines all normal vectors for each polygon of 
the model’s surface, 

2. calculating the normal vectors for shared vertices between adjacent polygons by simple vector addition, 

3. calculating the shading intensities for each vector value, allowing the boundaries between adjacent polygons 
to be concealed by the shading, and 

4. assigning shading over the rest of the polygons by linear interpolation according to the normal vector values 
which constituted each vertex vector. 

The lighting model facility on the IRIS automatically calculates color using the geometries, colors, and properties 
of the current material, lights, and lighting model. One material, eight lights, and one lighting model are selected 
and bound as inputs to a lighting equation. The lighting equation determines the color at a point based on the normal 
and material properties and point’s position, the position and properties of the light sources, and the lighting model 
properties. The lighting equation is evaluated when the normal or graphics position of an object changes, depending 
on whether the light sources and view are local. The basic equation used for lighting in DAFT is: 

Cp — C emitted. Light + ^ambient reflected light + Cdi f fuse re fleeted light C specular reflected light (1) 

where C p is the color of the point. The other components of the equation are: 

Cemitted light is the emission color of the material. Associated with self-luminous materials. 

C am hient reflected light = C t a * C m a + Cla * Cma ( 2) 

where C, a is the color of ambient light in the scene, Cma is the ambient color of the material, Cia is the ambient 
color of the light, and ambient light is the scattered light in a scene. 

Cdiffuee reflected light = Q* Cmd * ( Npi • Np) ( 3) 

where C/ is the color of the light, C m d is the diffuse color of the material, Npi is the direction from point P to the 
light Pi, N p is the normal to the surface at point P, and diffuse light is directed light which is reflected uniformly in 
all directions. Figure 4 shows the symbology representation. 

C specular reflected light = Cl * Cms * [ Np • Nf,] ^' m3s (4) 

where 

Nk = (^e«+ JVgj) / 1^ + Njtl (5) 

aHd Cma is the specular color of the material, Nt, is the bisector vector, Npe is the direction from point P to the 
eye P e , Emss is the material’s specular scattering component, and specular light is directed light that is reflected 
nonumformily depending on direction. Figure 5 shows the symbology representation. 

Figure 6 shows the process the IRIS used for a lighting calculation. Users can control the color, location, and 
direction of the light source or sources; the color and surface properties of the object; and the position and view 
direction of the observer. 

X-29 DISPLAY ROUTINES 

Many computer generated images cannot show the dynamic capabilities of components of the object For in- 
stance, an X-29 model should demonstrate mobility of the flaps, strakes, canards, and rudder, based on simulation 
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surface position. The IRIS system can dynamically manipulate individual surfaces of displayed models. The ability 
to view attitudes and dynamic surface positioning helps engineers monitor and verily aircraft capabilities. 

The components of the X-29 model are stored in several data files (one file contains data to draw the canards, 
another the rudder, etc.). The use of “component" data files allows the X-29 model to have dynamic surfaces. For 
example, if information is sent from the simulator to the IRIS with data simulating a positive 30° rotation of the left 
canard, then the displayed model will respond by rotating its left canard by positive 30°. Using component data files 
also allows for future program expansion; if the landing gear position needs to be shown, for example, then data 
representing the gear could be placed into data files and graphically displayed by DAFT. 

Object file formatting (OFF) is one particularly useftil capability of the IRIS. OFF groups together sequences 
of drawing routines and uses identifiers as headers. When a reference is made to an identifier, a series of drawing 
routines is initiated. As used by the X-29 display routines, OFF follows these steps: 

1. a component data file is created containing polygon surface definitions, such as coloration, data points, and 
origin location, 

2. an OFF reader file reads the definitions with the aid of include files containing global system definitions and 
variables, operational codes, and other indices, and 

3. the main program assigns identifiers to each component and references them for display when appropriate. 

Velocity vector components which allow the user to determine airspeed, angle of attack, and flight direction are 
included in the display (fig. 7). Each component originates from the nose of the aircraft model and is color coded 
for easy identification and determination of the aircraft’s velocity in any of the z-, j/-, or 2 -axes of earth-referenced 
three-dimensional space. Using the parameters of the aircraft’s velocity, angle of sideslip, and angle of attack, the 
overall velocity is broken into its various components and then relinked to form a “velocity viewing window.” This 
window structure is better suited for three-dimensional viewing than a two-dimensional vector line, allowing easier 
data assimilation and display. 

MODEL MANIPULATION ROUTINES 

Matrices and matrix multiplication are used to accomplish the three-dimensional transformations used in DAFI. 
DAFI uses a right-handed, homogeneous coordinate system to support its transformation operations. 

Objects are translated to new positions by adding translation amounts to the coordinates of each point of the 
objects. Using a homogeneous coordinate system allows simple matrix multiplication, rather than matrix addition, 
to be used to do the translation, represented by: 


I 1 

[z'yVl] = [xyz\] j ® 
| dx 


0 0 
1 0 
0 1 
dy dz 


0| 

0| 

0| 

II 


( 6 ) 
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yielding the linear equations: 


x' = x + dx, 


(7) 

y'=y+ dy, 


(8) 

z' - z+ dz. 


(9) 

Objects are rotated to new positions by rotating their component points through an angle 8 about an assigned 
origin. Though rotation by matrix multiplication does not require homogeneous coordinates, the homogeneous 

system is applied for uniformity of matrix operations. Rotation about a given axis is calculated as: 


|1 0 0 

0| 


r , , r n 1° 0080 sin 8 

[*„*l]-[*vzlj | 0 _ sfae ^ 

0| 

0| 

(10) 

jo 0 0 

11 


yielding: 



x' = X 


(ID 

y' = y cos 8 — z sin 8 


(12) 

z' = y sin 8 + z cos 8 


(13) 

about the x-axis, 



| cos 8 0 — sin 8 

0| 


[*v*'i] = [ *i«ij |° tae ■ “ os9 

0| 

0| 

(14) 

|0 0 0 

11 


yielding: 



x' = x cos 8 + z sin 8 


(15) 

y' - y 


(16) 

z' = —x sin 8 + z cos 8 


(17) 

about the y-axis, and 



| cos 8 sin 8 0 

0| 


r / / /n r n — sin 8 cos8 0 

[xyz 1] = [xyzl] ' Q j 

0| 

0| 

(18) 

|0 0 0 

11 


yielding: 



x' = x cos 8 — y sin 8 


(19) 

y' = x sin 8 + y cos 8 


(20) 


z' = z (21) 

about the z-axis (Gemini Technology Coiporation document no. GE881022, Generic Visual System (GVs) Ethernet 
Local Area Network Communications). 
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Positive rotation about each axis is: 


Axis of Rotation 

Direction of 
Positive Rotation 

X 

y to z 

V 

z to X 

z 

x toy 


COMMUNICATIONS ROUTINES 

An Ethernet link between the simulator and the woricstation is used for data transference (described by Martin 
Pickett of NASA Ames-Dryden in an unpublished document). Ethernet communication is established at the socket 
level. A socket is defined by a hostname (the machine to be contacted), a pair of addresses for socket location, and a 
protocol type, either transmission control protocol (TCP), user datagram protocol (UDP), or internet protocol (IP). 
The TCP is a connection-oriented, end-to-end reliable protocol designed to fit into a layered hierarchy of protocols 
supporting multinetwork applications. The TCP provides reliable interprocess communication between pairs of 
processes in host computers attached to distinct but interconnected computer communication networks. The UDP 
provides a procedure for application programs to send messages to other programs with a minimal mechanism. The 
protocol is transaction oriented, and delivery and duplicate protection are not guaranteed. The IP implements two 
functions: addressing and fragmenting. The internet modules use the addresses carried in the internet header to 
transmit datagrams toward their destinations. The internet modules use fields in the internet header to fragment and 
reassemble datagrams when necessary for transmission through “small packet” networks ( Generic Visual System 
( GVs ) Ethernet Local Area Network Communications ). The UDP is fastest because its functioning is simple and it 
neglects error checking. Its speed was ideal for real-time application, so UDP, rather than IP or TCP, was used to 
develop DAFI. The socket is established by a background process associated with DAFI, which maintains shared 
memory. Shared memory allocates space that multiple processes can use. Once a socket is bound, the background 
process reads the data sent from the simulation computer and places the data into the shared-memory space. DAFI 
accesses the memory space and reads the latest available data. Using shared memory reduces latency associated 
with reading data directly from a buffer. When reading data from a buffer, an information overflow may occur. If 
data is placed in the buffer faster than the data can be read, a stack of old data equal to the buffer size can develop. 
While DAFI reads through the stack all new data are placed at the bottom and not used until reached. The result is 
a delay, or latency, in DAFI’s response to external input and a hinder to real-time operation. 

The background process also closes the communication link and removes the shared memory space when the 
DAFI program is terminated. The processing path followed is shown in figure 8. The parameters being sent (listed 
below) are all floating points. 
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Parameter 

Units 

Left canard position 

deg 

Right canard position 

deg 

Left flap position 

deg 

Right flap position 

deg 

Left strake position 

deg 

Right strake position 

deg 

Rudder postion 

deg 

Angle of attack 

rad 

Angle of sideslip 

rad 

Pitch attitude 

rad 

Roll attitude 

rad 

Heading angle 

rad 

Pitch stick position 

in. 

Roll stick position 

in. 

Parameter 

Units 

Rudder pedal 

ia 

Altitude 

ft 

Velocity 

ft/sec 

Acceleration in X direction 

9 

Acceleration in Y direction 

9 

Acceleration in Z direction 

9 

Time 

sec after 


midnight 

These parameters are used by the model manipulation routines to drive the display. Other parameters can be added 
as needed and integrated into the model manipulation routines. 

Current Applications 


For simulation puiposes, DAFT can be used to display aircraft dynamics. Simulation manuevers which could be 
applied during an actual flight can therefore be designed. If pilots and ground-controllers know what dynamics to 
expect, they can conduct flights with reduced odds of undesirable occurrences. 

Postflight analysis can be accomplished by using stored flight data as input parameters. Users can playback flight 
data and observe aircraft response in close detail. Playbacks can be done in slow-motion and from various viewing 
angles, allowing for a complete analysis of the aircraft. Investigations of aircraft dynamics and data comparisons 
can be evaluated and stored on video tape for future playbacks and reference. 

Display position correlation matches the location of a displayed object on the screen with a specific parameter 
value. For example, the X-29 display would originally be centered on the screen. When the aircraft accelerates, the 


model would move from the center in the direction of the acceleration. Figure 9 shows a simple, two-dimensional 
example of the concept. 
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Future Applications 


The DAFI can display any aircraft, because of the component data files it uses. A library of data files for various 
aircraft components could be built to facilitate this feature. A wide display capability would prevent DAFI from 
becoming obsolete. 

Display position correlations need not be limited to accelerations. Correlations could also be made with regards 
to kinetic enexgy accumulation by the aircraft, induced lift, or other relations desired by the user. 

In addition to providing a display for simulated aircraft performance, DAFI could serve as a real-time display 
in mission control for actual test flights. The display capabilities of DAFI may be valuable tools to test engineers 
for flight monitoring. The instrumented test aircraft would telemeter data to ground station computers, which would 
bus the received parameters through Ethernet to the IRIS workstation. Since the DAFT display could be used as a 
direct representation of an aircraft in flight, external malfunctions with the aircraft could be reflected in the display. 
Uncorresponding surface positioning and associated aircraft attitude could alert controllers of failure. If the aircraft 
control surfaces were not positioned as expected for a given pilot input or a particular flight condition then a failure 
occurrence would be noted. A dynamic aircraft display corresponding to actual attitude and surface positioning data 
can verify proper aircraft functioning faster than sorting through a strip chart or a list of parameters. 

The IRIS color capabilities and resolution allow DAFI to do thermal modeling. A simplistic approach to thermal 
modeling might be: 

1. Fragment aircraft component surface data files into smaller, discrete units. 

2. Develop a file containing a color chart and associated color ranges. 

3. Expand the input variable listing to accept data from temperature probes on the aircraft. 

4. Provide a routine within the model display routines to monitor and assign appropriate coloration to each aircraft 
component, using the color file. 

The accuracy of the coloration mapping would be limited only by the size of each component data. The smaller 
the data units, the more precise the display. Thermal modeling would be beneficial for hypersonic aircraft research, 
especially for individuals in the acrothermodynamics discipline. Thermal analysis and aircraft flight envelope study 
could be accomplished quickly by viewing a color thermal display. 

Structural loads could be analyzed in the same way as thermal modeling. Strain gages on the aircraft would 
provide the parametric input and a color scheme assignment would differentiate the various input values. As loads are 
applied to the aircraft, a color mapping of the displayed model would allow users to determine quickly and accurately 
the structural integrity of various parts of the aircraft. This quick analysis would allow viewers to determine if a 
component is approaching failure. 

Remotely piloted vehicles (RPVs) cannot always be watched closely during test flights. Though means are 
available for tracking RPVs, a visual display could be a useful addition. Erratic flight characteristics could indicate 
technical difficulties more quickly than sorting through numeric displays of relayed flight parameters. 
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CONCLUDING REMARKS 


Computers have provided engineers and scientists a practical means of observing phenomena of interest. Dy- 
namic aircraft flight imaging (DAFI) is the latest method of observation. The displayed images can relay data in 
a form more easily assimilated than strip charts and numeric displays. The use of DAFI is not limited to the X-29 
aircraft. This software package can be a general display tool for many scientific and technological interests because 
of its intrinsic expansiveness and potential for varied applications. 

Ames Research Center 
Dryden Flight Research Facility 
National Aeronautics and Space Administration 
Edwards, California, August 14, 1990. 



Figure 1. Velocity vector components. 
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(b) Backfacing polygon removal technique. 
Figure 2. Hidden-surface removal. 
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(b) Gourad shading. 

Figure 3. Continued 
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Figure 7. The DAH model with velocity vector components. 
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Figure 8. Program processing path. 
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